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Definition of a Virtual Environment 


A virtual environment is an interactive, virtual image dis-play enhanced by 
special processing to convince its users that they are personally and directly 
physically immersed in a space other than the one they actually inhabit . 



Ivan Sutherland's HMD Univ. of Utah 



Ivan Sutherland’ s virtual environment personal simulator 1 circa 1965 


'Haber, R. N. (1986). The simulation of high speed aircraft flight. Scientific American, 255, (July) 96-103. 



Some Head-Mounted Displays & Viewers Over Time 
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Abstract Decomposition of an Environment 



E={g(f(xXx), t} 


Example of Path Following 
Latency ~380 ms 




Intersensory Performance Effects 
of Latency in A Virtual Environment 


Hand Translation 
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Head Translation 
and Rotation 

Error 
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Error in the 
direction of motion 


Error against the 
direction of motion 


Superposition of errors 
both in and against the 
direction of motion for 
translation and rotation 


Internal Latency (msec) 


System Latency with some Polhemus-based Systems 
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Measure and Model 
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(unpublished) 


Jacoby, et al . (1996). Proc. of the SPIE 2653, Stereoscopic displays and virtual reality systems III Feb., 1996. pp. 271-284. 



Example of Path Following 
Low Latency ~1994 




Some Characteristics of the Head Mounted Display System Used 

Or Where We Were ~ 

1 990? (at least some of us) 

Weight 

0.77 - 1 . 1 kg Thank you Sony ! 

Visual 

Resolution 1024 X 768 

-> -700 X 525 check VIEW hardware 

Brightness min/max 

6/68 cd/m 2 - w/r see-thru background 

FOV 

20° -3 2° diameter 

Contrast(Michelson) 

0.6 - 0.8 - w/r see-thru background 

Color 

Monochrome 

Accommodative Demand 

1 diopter (adjustable) 

Stereo resolution 

-2-3 arcmin 

Stereo overlap 

100% 

IPD 

60 -78 mm 

Tracking & Rendering 

Polhemus Fastrak/vairous SGI/PCs 

Accuracy 

~±5mm, 1-2° 

Resolution 

< 1 mm, < 0.24° 

Position sensing: 

120 Hz 

Frame (Update) rate: 

60 Hz 

Latency 

-45 ms (now 8-25 ms) 

User Interface 

None: voice to computer operator/HMD assistant 



Latency Discrimination in Virtual Environments 

Two- Alternative Forced Choice Discrimination 
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| (~35 ms) | added latency 
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Catch trials 

• Method of constant stimuli 

• Randomized blocks each base t (224 judgments) 

• Sub-blocks each increment At (32 judgments) 

• 3 repetitions per subject 

(Ellis, Young, Ehrlich , 

• Metronome-paced movement 0.5 Hz ^ Adelstein, 1999) 


Probability 

Correct Detection Probability 


Observer Detection of Changes of Latency 
during Paced Hand Movement of Virtual Objects 


No Webers Law: At/tj not constant! 

Hits False Alarms 




Latency Change (msec) Latency Change (msec) 

* Practiced observers using an occluding HMD 

Ellis, Stephen R. , Young, Mark J. , Ehrlich, Sheryl M., and Adelstein, Bernard D. (1999) Discrimination of 
changes of latency during voluntary hand movement of virtual objects . Proceedings of HFES . pp. 11 82- 1186. 


Latency Detection One Subject Making Head Rotations 

Data Analysis Procedure 



•Accumulated responses from 10 ascending 10 descending runs 
•Probit Analysis^ Gaussian Quartiles->PSE & JND 


Latency Discrimination During Head Movement: Graphic Models 


Target Background Target & Background Room 




Backoround 
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Medians 


Latency Discrimination during Head Movement 


80 

70 


co 

E 


CO 

E 


LU 

CO 

Q_ 


60 
50 
40 
30 
20 
10 
0 

70 
60 
50 
40 
30 
20 
10 
0 

Object Background Both Room 




rD 


QJ 

15 

crq 

rD 


cf 

Hand 

Movement 
JND ~25 msec 
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Hand 

Movement 
PSE ~45 msec 


Ellis et al (2004) Proc. of the Human Factors and Ergonomics Society pp. 1836-1841. 




DK1 100% overlap 

640x480 @ 110 degrees 
"6 pixels / degree 

f 

DK2 

960x1080 @ 100 degrees 
10 pixels / degree 


s 
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100% overlap Vive 

1080x1200 @ 105 degrees 
~10 pixels / degree 

fVReliaProGl 
1920x1080 @ 123 degrees 
~15 pixels / degree 



Sony Morpheus 


Courtesy and after Mark Mine, Dir. Disney, Disney Research 



Some Imagined Performance Specs for HMDs but 
especially for dream Augmented Reality 



Bi-jocular/stereo optical see- 
through AR 


4 '/pixel visual resolution! 


Presenting accurate disparities 


Adaptive (or just correct] 


disparity w/r vergence 


> 60° binocular see-through 
horizontal FOV, Partial QL OK 


[increment up to 3 X 10 4 |cd/m^| 
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nonocclusive format 

Embedded fast 
head, hand & 
world tracking 

< $ ms image 
updajte latency 

^ 120 Hz image 


Mobile phone equivalent 


Everything else I left out| 




